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Background: Alcohol screening and brief intervention (SBI) reduces drinking among at-risk 
drinkers. Lack of training and negative attitudes represents a barrier to SBI performance. This 
study evaluates the impact of a medical student workshop using recovering alcoholics in simulated 
patient interviews to teach SBI skills. 

Methods: Third-year students (n=94) were surveyed before and after a 3-hour alcohol SBI 
workshop regarding their perceived importance and confidence in performing eleven SBI 
behaviors. Students were also asked to list factors increasing and decreasing motivation to 
conduct SBI. Students completing off-campus rotations (n=71) served as controls, completing 
surveys during the same time period but without attending the workshop. 
Results: Analysis of variance found a significant interaction effect between the students 
participating in the workshop and control students on both importance scores [F(2,174)=3.34] 
and confidence scores [F(2,174)=9.13], indicating higher scores for the workshop students at 
the follow-up time periods. Commonly listed motivators for performing SBI included clinical 
experience with alcohol misuse and the impact of alcohol on health and relationships. High 
relapse rates and patient reactions to questions about alcohol use decreased the motivation to 
perform SBI. 

Conclusion: SBI workshops that include recovering alcoholics as simulated patients can 
produce long-term improvements in students' perceived importance and confidence in per- 
forming SBI. 

Keywords: alcohol, screening, medical students, brief intervention 

Introduction 

Despite widespread evidence of the health impact and economic importance of alcohol 
misuse worldwide'"' and evidence that simple brief interventions by physicians can 
reduce alcohol misuse and related health care consequences,""' physician screening and 
brief intervention (SBI) is infrequently performed,"'"''' with many physicians reporting 
inadequate training in this area.'^"^^ For several decades, key national and international 
organizations including the World Health Organization, American Medical Council 
on Mental Health, Medical Council on Alcoholism, and Office of National Drug 
Control Policy have called for increased education about alcohol misuse for students 
in medical schools.^'"^^ 

Surveys of medical students have revealed frequent negative attitudes toward 
patients with drug and alcohol problems,^'"'^ with one study indicating that the attitudes 
of medical students worsen during medical training.'^ Because a strong correlation 
has been identified between physicians' attitudes, confidence, and role legitimacy on 
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reported screening and treatment practices with patients who 
misuse alcohol and other drugs,'^^^ alcohol training programs 
typically target clinicians' attitudes, as well as their knowl- 
edge and skills. The goal of such training is to dispel any 
existing biases against these patients and increase clinicians' 
commitment to addressing patterns of misuse, as well as their 
medical or surgical consequences. ^"•^''•^^ Numerous programs 
designed for practicing clinicians indicate that a combination 
of didactic education and skills training increases clinicians' 
confidence in performing alcohol SBI and increases rates of 
alcohol intervention. ^"'•"'^^ 

A 2000 review of the existing literature by El-Guebaly 
et al concluded that improving medical students' knowledge 
and skills was easier to obtain than attitudinal shifts.''^ Two 
studies from the early 1990s reported changes in student 
attitudes using a model substance abuse curriculum and an 
intensive interactive seminar, including seminars, 12-step 
meeting attendance, and role plays with standardized patients; 
however, changes were not sustained during clinical train- 
ing.'*''''^ Two clinical training experiences from the last decade 
report positive attitudinal change. Silins et al found that a 
clinical rotation including 2 weeks on an addiction treat- 
ment unit resulted in decreased dislike of problem drinkers, 
a greater sense of responsibility towards providing interven- 
tion, and less anticipation of discomfort working with these 
patients.^" Similarly, Christison and Haviland found that 
1 -week in addiction medicine as part of a psychiatry rotation 
changed students' perceptions of working with patients with 
substance abuse problems. Following the rotation, students 
were more likely to describe the patients as treatable, and 
worthy of medical resources." 

Similarly, workshops have been utilized to teach SBI 
skills and improve student attitudes toward patients with 
substance use problems. Two trials of 3-hour interventions 
in Australia found that both simple didactic training and a 
combination of didactic plus experiential training improved 
student attitudes toward patients misusing alcohol, although 
neither was sufficient to provide students with adequate 
brief intervention skills.''^ '"' Kahan et al found that a 3-hour 
skills-based workshop resulted in increases in knowledge of 
drinking reduction strategies, increases in assessment and 
management scores, and increases in self-efficacy, although 
commitment to treatment returned to near-baseline levels at 
the 4-month follow-up.'" Comparison of a brief intervention 
lecture versus a rich media web module resulted in increases 
in confidence to perform brief intervention in both groups, 
with web-trained students achieving higher brief interven- 
tion scores on observed structured clinical examinations; 



however, no information on attitudes or long-term outcomes 
is available."* 

Standardized and simulated patient interviews (SPs) are 
a preferred strategy for teaching skills because they provide 
a safe learning environment, opportunity for feedback, and 
increase learners' self-confidence.'"'^'' Use of recovering alco- 
holics as SPs to teach alcohol interview skills offers unique 
potential advantages: practice interviews with emotionally 
authentic SPs in stable recovery might increase student 
confidence in alcohol brief intervention while also increas- 
ing their sense of the importance of engaging patients in 
conversations about their alcohol misuse. A 2012 literature 
search found no prior studies that examined the attitudinal 
impact of utilizing recovering alcoholics as SPs in alcohol 
intervention workshops. 

The following analysis describes a 3-year evaluation of 
an alcohol training workshop designed to produce long-term 
increases in students' perceived importance and confidence 
in performing the specific components of alcohol SBI and 
to explore factors which increase or decrease students' 
motivation to perform brief interventions. 

Materials and methods 

In this study, approved by the Mercer University institutional 
review board, third-year medical students participating in 
their family medicine rotation provided appropriate written 
consent and then completed a baseline attitudes survey which 
measured their perceived importance of and confidence in 
executing eleven behaviors related to alcohol screening, 
intervention, and referral. The behavior list was developed 
based on components of effective SBI intervention studies 
described in the US Preventive Services Task Force's rec- 
ommendation statement advocating alcohol screening and 
behavioral counseling for all adult primary care patients.^' 
Students were asked to rate these Likert scale items on a scale 
of 1 to 10, with 1 representing low importance/confidence and 
10 representing high importance/confidence. Evaluation also 
included two open-ended questions: "List any aspect(s) of 
your medical training that has (have) increased (or decreased) 
your motivation to screen and intervene with patients who 
are problem drinkers." 

Of 1 72 students invited to participate, 1 65 were consented 
and completed the baseline survey. Students at the medical 
school's main campus (n=94) then participated in an alcohol 
intervention workshop, while students completing their 
family medicine rotation at off-campus sites (n=71) served 
as study controls. While students were allowed to select the 
location of their rotation, with the exception of the alcohol 
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intervention workshop, the education experience is similar 
across sites. All graded components, readings, testing, and 
student evaluations were identical and coordinated from one 
campus by a single coordinator Although not randomized 
to these locations, there should not be any systematic dif- 
ferences between students electing local rotations and those 
in other locations. 

The skills-based intervention workshop included a 1-hour 
lecture on the components of alcohol SBI, a 15 -minute 
practice interview with a recovering SP that allowed them 
to practice the skills covered in the lecture, then a debrief- 
ing feedback session for all students and patients. A typical 
workshop would include five to eight recovering SPs. Over 
the duration of the study, approximately 35 recovering per- 
sons served in SP roles. While some SPs participated in a 
2-hour training session which included practice interviews, 
most participated only in a half-hour orientation using a two- 
page description of the role they were requested to depict, ie, 
that of an active alcoholic on a first visit to a physician for a 
complaint with some relation to alcohol use (eg, accidents, 
abdominal pain, depression, insomnia). SPs were given lib- 
erty to provide their own details regarding their medical and 
social history. They were asked to admit to drinking alcohol, 
but be vague and evasive at first, giving more details if the 
doctor was persistent in asking about quantity and frequency. 
In response to brief intervention, they were asked to be 
somewhat resistant at first then agree at least to consider the 
student's suggestions and come back for a follow-up visit. 
Specifically, they were told that one purpose of the exercise 
was to give students the message that at least some alcoholic 
patients are open to talking about recovery, and that it is worth 
taking the time to talk with other patients in the future. For 
that reason, they were asked not to portray a patient in total 
denial, but rather an ambivalent patient in some degree of 
denial who begins to open up with a physician demonstrating 
concern and investing time in conversation about drinking. 
After the interviews, all students and patients participated in 
a debriefing session in which SPs were asked to give positive 
feedback on something the student did well, one suggestion 
on something that might improve future interviews, and spend 
5 minutes each sharing their recovery stories. 

The baseline survey was readministered to all students 
1 month and again 9 months after the workshop during the 
final year of medical school training to determine if confi- 
dence in and perceived importance of the various compo- 
nents of alcohol SBI increased as a result of the workshop 
and if changes would be retained over time. Follow-up rates 
were 97.5% at 1 month and 63% at 9 months, with slightly 



better rates for the intervention group (68%) than for the 
control group (55%). To test for possible response bias, 
independent-samples tests were performed on baseline 
importance and confidence items comparing those complet- 
ing the 9-month follow-up with those who did not respond. 
The results showed significant differences on only two of the 
eleven importance items and none of the confidence items. 

Individual items were summed to create importance and 
confidence scale scores (possible range 1 1-1 10) at each of 
the three time periods (baseline, 1 month, and 9 months). 
Analyses were conducted using a mixed analysis of vari- 
ance design. Significant interactions indicate a significant 
difference between the workshop and control groups. Free 
text answers were entered into an Excel file and indepen- 
dently grouped into areas with common themes by two of 
the study's authors. 

Results 

Comparison of workshop students 
with control group 

Paired-samples f-tests of individual importance and confi- 
dence items showed that 1 8 of 22 items, including each of the 
eleven confidence items, increased significantly over baseline 
scores. At the 9-month follow-up, 12 of 22 individual means 
continued to be higher when compared with baseline. 

At baseline, the mean score on the importance scale was 
84.6+15.7 with a range of 3 9- 1 1 0, while the mean score on 
the confidence scale was 92.1+12.9 with a range of 38-1 10. 
Changes in the mean scale scores resulting from the work- 
shop were tested using separate mixed analyses of variance. 
The results are shown in Table 1 . 

There was a significant interaction effect between confi- 
dence and group [7^(2, 1 74)=9. 13], indicating that the overall 
level of confidence in SBI differed significantly between stu- 
dents in the workshop group and those in the control group. 
The F-statistic for the main effect of the intervention was 
not statistically significant [F(2,174)=2.13], suggesting that 
the workshop did not significantly increase students' overall 
confidence in performing SBI. 

Contrasts were performed comparing I -month and 
9-month scores on confidence with baseline scores for the 
workshop and control group. These contrasts revealed a sig- 
nificant interaction when comparing the two groups' scores at 
1 month with baseline [F(l,87)=14.89]. Contrasts comparing 
9-month scores with baseline were not statistically significant 
[F(l,87)=0.420], as shown in Figure 1. 

For the importance measure, there was also a significant 
interaction effect with group [F(2,174)=3.34], indicating that 
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Table I Changes in mean aggregate confidence and importance scores for worl<shop and control group at baseline, and I month and 
9 months post intervention 
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9.13 (<0.00) 


Control 
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3.34 (0.04) 
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84.1 (15.4) 


85.7 (10.7) 


90.4 (13.0) 







Abbreviation: SD, standard deviation. 



the overall level of importance of SBI differed significantly 
between students in the workshop group and those in the 
control group. In addition, the results showed a statistically 
significant main effect [_F(2,174)=14.35], suggesting a sig- 
nificant increase in the perceived importance of SBI among 
those completing the workshop. As with the confidence 
measure, contrasts revealed a significant interaction when 
comparing the two groups' scores at 1 month with base- 
line [7^(1,87)=5.80], and a nonsignificant interaction when 
comparing 9-month scores with baseline [F(l,87)=1.70], as 
shown in Figure 2. 

Free text responses 

Results from the two open-ended questions revealed com- 
mon themes for both the intervention and control groups at 
baseline. The two most common responses regarding factors 
that increased students' motivation to conduct SBI were the 
students' clinical experience with alcoholism and the effect 
of alcohol on patients' physical health. These responses 
occurred about three times as frequently as the next most 
common response, ie, the effects of alcoholism on relation- 
ships and the family. Clinical experience and physical health 
responses continued to be the most common response for 



both groups at the 1 -month and 9-month follow-ups. At the 
9-month follow-up, however, the alcohol workshop emerged 
as the third most common response among the intervention 
group, mentioned by eleven of 64 respondents. 

There were less than half as many open-ended responses 
regarding factors that decreased motivation to screen and 
intervene. The most common responses for both the control 
and intervention groups were the difficulties associated with 
treating patients with alcohol disorders, the high incidence 
of relapse, and patients' negative reactions when asked about 
their alcohol use. These themes remained the most common 
responses for both the control and intervention groups at both 
the 1 -month and 9-month follow-up. 

Discussion 

These results are consistent with previous studies in showing 
that brief alcohol workshops can improve medical students' 
confidence or self-efficacy in addressing alcohol-related 
problems through brief interventions.'' " The results also 
indicate that these types of workshops impact student 
attitudes (ie, importance of performing SBI), and that changes 
can persist over time. Recent research has shown that implicit 
measures (eg, importance and confidence) are often more 
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Figure I Mean confidence scores for baseline, I -month, and 9-months post 
intervention. 



Figure 2 Mean importance scores for baseline, I -month, and 9-months post 
intervention. 
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predictive of actual behavior than explicit measures. ^^-^ When 
compared with a control group, workshop participation was 
associated with higher scores on 20 of 22 importance and con- 
fidence items related to performing alcohol SBI tasks 1 month 
after training and 12 of 22 items after 9 months. When these 
items were combined into overall measures of importance 
and confidence, mixed analysis of variance showed statisti- 
cally significant differences between the workshop group and 
the control group, with scores increasing for the workshop 
group after training but remaining static or decreasing for the 
control group. After 9 months, differences between the two 
groups converge slightly, but both confidence and importance 
scores remain higher for the workshop group. 

The lack of a significant main effect for confidence 
scores is likely the result of already high mean scores on 
this measure (92 out of a possible 1 10), leaving little room 
for significant change. Prior to training, medical students 
may perceive the skills required to address patients' alcohol 
use as less difficult than the skills needed to address other 
acute or chronic conditions, resulting in inflated scores on 
confidence. Mean confidence scores did increase for the 
workshop group, but the increase was not enough to reach 
statistical significance. 

Students' free text responses on factors that increased 
their motivation to screen and intervene with problem 
drinkers are instructive. Comments regarding factors that 
motivated students to intervene outnumbered comments on 
factors that decreased motivation by a ratio of 4: 1 . Seeing the 
clinical impact of problem drinking, particularly its physical 
sequelae, appears to be a strong motivator for students to 
screen and intervene. Clinical experiences with problem 
drinkers were the predominant motivating factor for both the 
intervention and control groups across all phases of the study. 
Mentions of the impact of alcohol on physical health were 
also common in both groups throughout the study. Students' 
free text responses regarding factors that decreased their 
motivation to screen and intervene with problem drinkers 
are also instructive, although the overall number of com- 
ments was small. Students in both the control and interven- 
tion groups most commonly listed the difficulty in treating 
problem drinkers and high relapse rates, factors that would 
appear to relate to the "treatment pessimism" described in 
previous studies.^* Similarly, patients' negative responses 
to questions about alcohol decreased students' motivation, 
perhaps reflecting many physicians' desires to have positive 
patient encounters that leave both patients and physicians 
feeling good after the encounter Future studies may wish 
to explore whether these factors decline as students become 



more proficient in interview techniques, such as motivational 
interviewing, that focus on collaborative approaches equip- 
ping students to assist patients in evoking their own reasons 
and rationale for change. 

The most innovative aspect of this study is the use of 
recovering alcoholics as simulated patients. Using brief 
predetermined scenarios, the patient-actors have the free- 
dom to use details from their own personal experience to 
make the interview more realistic. Students are not told 
in advance that the SPs are recovering alcoholics. During 
the debriefing period at the end of the workshop, students 
often make positive comments about the authenticity of the 
answers and emotional reactions of SPs. This suggests that 
the SP approach may combine positive aspects of both "real" 
patient and standardized patient encounters by providing 
both authenticity and the opportunity for feedback.'" As SPs 
reveal their recovery status at the close of the workshop, 
students may recognize the "hidden" nature of alcohol misuse 
and realize the importance of screening everyone in their 
future practices. One potential area for future study would 
be to attempt to measure the impact of such an experience 
on students' commitment to routinely screen all patients 
for alcohol misuse and intervene as indicated (so-called 
"therapeutic commitment") and on their actual SBI practice 
behaviors. 

The study has several limitations. Students were not ran- 
domized to the control and intervention conditions, although 
there is no indication that there are systematic differences 
between the two groups that would affect the study results. 
Nonetheless, there were baseline differences in the control 
and intervention groups that limit our ability to attribute all 
these changes to the workshop alone. Reasons for these dif- 
ferences are unclear Surveys were administered by office 
personnel during the family medicine rotation orientation, 
making it unlikely that these responses reflect a social desir- 
ability bias. 

While the use of recovering SPs is a unique addition to the 
workshop, it is not possible to separate the effect of this aspect 
of the workshop from the workshop's other components. 
Future studies should randomize students into workshops 
with and without recovering SPs to determine if there is an 
independent effect of this workshop component. 

The follow-up rates at 9 months may also have impacted 
the study results, particularly the low follow-up rate (55%) 
for control group participants at the 9-month follow-up. This 
could impact both the statistical power necessary to identify 
statistically significant results as well as introduce possible 
nonresponse bias. 
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Finally, there was variability in the training of SPs, 
with some receiving more extensive training than others. 
This variability could have been reflected in the SP/student 
encounter. We are unable to link individual SPs to student 
responses and therefore unable to account for difference in 
training in the study results. 

Overall, the study indicates a very positive impact of a 
brief alcohol workshop. Future studies should attempt to link 
the impact of such a workshop to alcohol SBI behaviors after 
students move into residency. 
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